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BACKGROUND OF INVENTION 

a. Field of Invention 

[0001] The present invention relates generally to an image encoding device which compresses 
and encodes images. The invention also relates generally to an electronic camera which is 
equipped with the image encoding device. The invention further relates generally to an image 
encoding program which is used to realize the image encoding device in a computer, and a 
recording medium for the image encoding program. 

b. Description of Related Art 

[0002] In December of 1 999, a committee draft (CD) of the JPEG2000 encoding algorithm 
was prepared, and the main technical content forming the core of this draft was finalized. 
[0003] The processing steps of the JPEG2000 encoding algorithm will be outlined below. 
[0004] (1) Color Coordinate Transformation 

[0005] The input image is subjected to a color coordinate transformation as required. 
[0006] (2) Wavelet Transformation 
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[0007] The image is subjected to discrete wavelet transformation in the vertical and 
horizontal directions, and is divided into a plurality of sub-bands (LL, LH, HL, HH). Among 
these sub-bands, the LL band of the lowest frequency region is repeatedly subjected to 
debunching wavelet transformation in a recursive manner. 
[0008] (3) Quantization 

[0009] The wavelet transformation coefficients are quantized by each sub-band. Moreover, in 
lossy/lossless unified processing, the quantization step is set at "1." Furthermore, in the case of 
lossy compression, the less significant N bit planes are discarded in a post-process. This 

u discarding process is equivalent to the quantization step of the N th power of 2. 

g [0010] (4) Bit Modeling 

5 

ij1 [0011] Following quantization, the wavelet transformation coefficients are divided into 

p 

^ encoding blocks of a fixed size (e.g., 64 x 64) within each sub-band. Next, the transformation 

w 

7 , coefficients within each encoding block are divided into sign bits and absolute values, and the 

ry 

q absolute values are expressed in binary representation to construct bit planes. The bit planes are 

M 

□ then encoded in order from the upper bit plane via the following three types of encoding passes; 
significance pass, refinement pass and cleanup pass. Furthermore, immediately after the 
uppermost bits of the corresponding absolute values have appeared on the bit plane, the sign bits 
are encoded. 

[0012] (5) ROI (Region of Interest) Encoding 

[0013] In this function, in order to improve the decoded image quality of a selected region, a 
greater quantity of information is allocated to a selected region on the image. Specifically, the 
transformation coefficients (following quantization) that are positioned in the selected region are 
shifted upward by S bits, and are then subjected to the bit modeling, discussed above. As a 
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result, the selected region is shifted to the upper bit planes and is encoded with a higher priority 
than any bit of the non-selected region. 

[0014] Moreover, in the max shift method, the bit shift number S is set so that it is larger than 
the place number of the uppermost bit in the non-selected region. Accordingly, the non-zero 
transformation coefficients of the selected region always have a value of the S th power of 2 or 
greater. Consequently, during decoding, the transformation coefficients of the selected region 
can easily be reproduced by selectively shifting quantized values of the S th power of 2. 
[0015] (6) Arithmetical Encoding 
U [0016] (7) Bit Stream Formation 

Q [0017] Signal- to-Noise Ratio (SNR) progressive and space resolution progressive, are 

5 

v < realized by arranging the data of the respective encoding blocks according to combinations of 

jjijj four axes; importance of bit plane, space resolution, block position and color components. 

L 4 [0018] For example, in the case of SNR progressive, the respective encoding blocks are split 

fy 

H for each encoding pass, and the split data is classified according to the degree of contribution to 

H 

Q the improvement of SNR, so that a plurality of layers are constructed. An SNR progressive bit 

M 

stream is formed by lining these layers in a top-down order. Additionally, fixed-length 
compression can be realized by cutting this bit stream using an appropriate file size. 
[0019] Thus, a JPEG2000 compressed image file is produced by such an encoding procedure. 
[0020] It should be noted that the most recent and complete developments on JPEG2000 are 
available in the final committee draft published by the JPEG Committee on the internet at 
http://www.ipeg.org/fcdl5444-l.zip . Additionally, following the approval of international 
standards planned for March 2001, more detailed and accurate international standards can be 
ascertained via ISO, ITU-T and other standards organizations. 
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[0021] As discussed above, in the case of JPEG2000, the processing content of ROI encoding 
is regulated. The designation of the selected region, however, is not particularly regulated, but is 
left up to a user's discretion. Accordingly, in the specific realization of ROI encoding, there is a 
need for the establishment of more appropriate selected region designation. 
[0022] In particular, in the case of electronic cameras, fixed-length compression in which the 
amount of compressed code is more or less fixed is ordinarily performed. In the case of such 
fixed-length compression, the quantity of information for the non-selected region is reduced by 
allocating a greater quantity of information to the selected region. This leads to problems such 

I as a noticeable drop in the image quality of the non-selected region as a result of unplanned 

pi 

P region designation. 

vl 

Q [0023] Accordingly, one object of the present invention is to perform appropriate region 

SI 

O designation of the selected region. 

^ . [0024] Furthermore, another object of the present invention is to achieve an appropriate 

b 

Q balance in image quality between the selected region and non-selected region in fixed-length 

d 

M, compression. 



SUMMARY OF INVENTION 

[0025] In order to solve the above-mentioned problems, the present invention provides an 
image encoding device, including a transformation component for converting an image into 
transformation coefficients by subjecting the image to a frequency decomposition, the image 
having an area. The image encoding device further includes a dividing component for dividing 
the transformation coefficients produced by the transformation component into a selected region 
and a non-selected region on the image, the non-selected region being an area of the image other 
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than an area defined by the selected region, an encoding component for encoding the 
transformation coefficients by allocating a greater quantity of information to the selected region 
than to the non-selected region, and a region adjustment component for controlling a bit 
allocation rate of the non-selected region by adjusting the area of the selected region, the bit 
allocation rate being a mean amount of code per unit area. 

[0026] The region adjustment component further adjusts the area of the selected region by 
taking into account a bit allocation rate of the image as a whole, a bit allocation rate of the 
selected region, and the bit allocation rate of the non-selected region. Each of the bit allocation 
Ms rates is determined in advance as a target value. 

s 

□ [0027] Alternatively, the region adjustment component adjusts the area of the selected region 

O 

Ml by taking into account a bit allocation rate of the image as a whole, a bit allocation rate of the 

a 

, ; selected region, and a ratio of the bit allocation rate of the selected region to the bit allocation 
r 4 rate of the non-selected region. Each of the bit allocation rates and the ratio are determined in 

m , 

□ advance as target values. 

•3 

Q [0028] Furthermore, the region adjustment component determines an adjustment value of the 

U 

area of the selected region by substituting the target values into the following general calculation 
equation: 

y total = y roi x Aroi + y notroi x (1 - Aroi), 
where, y total is the bit allocation rate of the image as a whole, y roi is the bit allocation rate of 
the selected region, Aroi is a proportion of the area of the image as a whole that is occupied by 
the selected region, and y notroi is the bit allocation rate of the non-selected region, and solving 
the equation. 
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[0029] Moreover, the region adjustment component limits the adjustment value of the area of 
the selected region by at least a pre-determined upper-limit value or a pre-determined lower-limit 
value. 

[0030] The present invention further provides an image encoding device including a 
transformation component for converting an image into transformation coefficients by subjecting 
the image to a frequency decomposition, the image having an area. The image encoding device 
further includes a dividing component for dividing the transformation coefficients produced by 
the transformation component into a selected region and a non-selected region on the image, the 
KJ non-selected region being an area of the image other than an area defined by the selected region, 
Q an encoding component for encoding the transformation coefficients by allocating a greater 

Ci 

D quantity of information to the selected region than to the non-selected region, and a region 

Nl 

O adjustment component for controlling a bit allocation rate of the non-selected region by adjusting 
I*, a bit allocation rate of the selected region. 

=rj [0031] The region adjustment component adjusts the bit allocation rate of the selected region 

Q 

U by taking into account a bit allocation rate of the image as a whole, the area of the selected 

region, and the bit allocation rate of the non-selected region. Each of the bit allocation rates and 
the area are determined in advance as target values. 

[0032] Alternatively, the region adjustment component adjusts the bit allocation rate of the 
selected region by taking into account a bit allocation rate of the image as a whole, the area of 
the selected region, and a ratio of the bit allocation rate of the selected region to the bit allocation 
rate of the non-selected region. The bit allocation rate of the image as a whole, the area of the 
selected region and the ratio are determined in advance as target values. 
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[0033] Furthermore, the region adjustment component determines an adjustment value of the 
bit allocation rate of the selected region by substituting the target values into the following 
general calculation equation: 

y total = y roi x Axoi + y notroi x (1 - Aroi), 
where, y total is the bit allocation rate of the image as a whole, y roi is the bit allocation rate of 
the selected region, Aroi is a proportion of the area of the image as a whole that is occupied by 
the selected region, and y notroi is the bit allocation rate of the non-selected region, and solving 
the equation. 

[0034] Moreover, the region adjustment component limits the adjustment value of the bit 
allocation rate of the selected region by at least a pre-determined upper-limit value or a pre- 
determined lower-limit value. 

[0035] The present invention yet further provides an image encoding device, including a 
transformation component for converting an image into transformation coefficients by subjecting 
the image to a frequency decomposition. The image encoding device further includes a dividing 
component for dividing the transformation coefficients produced by the transformation 
component into a selected region and a non-selected region on the image, the non-selected region 
being an area of the image other than an area defined by the selected region, an encoding 
component for encoding the transformation coefficients by allocating a greater quantity of 
information to the selected region than to the non-selected region, wherein the encoding 
component encodes the transformation coefficients while gradually increasing allocation of a 
quantity of information from a peripheral part of the selected region toward a central part of the 
selected region, and a region adjustment component for controlling a bit allocation rate of the 
non-selected region by adjusting a slope of increase of the allocation. 
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[0036] The present invention yet further provides an image encoding device, including a 
transformation component for converting an image into transformation coefficients by subjecting 
the image to a frequency decomposition. The image encoding device further includes a dividing 
component for dividing the transformation coefficients produced by the transformation 
component into a selected region and a non-selected region on the image, the non-selected region 
being an area of the image other than an area defined by the selected region, an encoding 
component for encoding the transformation coefficients by allocating a greater quantity of 
information to the selected region than to the non-selected region, wherein the encoding 
s Cj component encodes the transformation coefficients while gradually increasing allocation of a 
^ quantity of information from a peripheral part of the selected region toward a central part of the 

H selected region, and a region adjustment component for controlling a bit allocation rate of the 

Si 

O non-selected region by adjusting a maximum value of a bit allocation rate of the selected region, 

jj* [0037] The present invention yet further provides an image encoding device, including a 

r! transformation component for converting an image into transformation coefficients by subjecting 

m 

the image to a frequency decomposition. The image encoding device further includes a region 
adjustment component for detecting a region of focus on the image and for determining a 
selected region on the image on the basis of the region of focus, a dividing component for 
dividing the transformation coefficients produced by the transformation component into the 
selected region and a non-selected region on the image, the non-selected region being an area of 
the image other than an area defined by the selected region, and an encoding component for 
encoding the transformation coefficients by allocating a greater quantity of information to the 
selected region than to the non-selected region. 



l-WA/ 1709005.1 



9 



Attorney Docket No. 040808-5 1 1 2 

[0038] The present invention yet further provides an image encoding device, including a 
transformation component for converting an image into transformation coefficients by subjecting 
the image to a frequency decomposition. The image encoding device further includes a dividing 
component for dividing the transformation coefficients produced by the transformation 
component into a selected region and a non-selected region on the image, the non-selected region 
being an area of the image other than an area defined by the selected region, an encoding 
component for encoding the transformation coefficients by allocating a greater quantity of 
information to the selected region than to the non-selected region, and a region adjustment 

Q component for detecting a region of focus on the image and for displacing the selected region in 
direction of the region of focus. 

? t [0039] The present invention yet further provides an image encoding device, including a 

!! transformation component for converting an image into transformation coefficients by subjecting 

U 

m the image to a frequency decomposition. The image encoding device further includes a region 

H adjustment component for receiving an input indicating a selected region on the image and for 

C3 

setting the selected region in accordance with the input, a dividing component for dividing the 
transformation coefficients produced by the transformation component into the selected region 
and a non-selected region on the image, the non-selected region being an area of the image other 
than an area defined by the selected region, and an encoding component for encoding the 
transformation coefficients by allocating a greater quantity of information to the selected region 
than to the non-selected region. 

[0040] It should be noted that in each alternative embodiment of the image encoding device 
discussed above, the region adjustment component reduces noise generated in the non-selected 
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region as a result of high-performance encoding by performing a space frequency low-pass 
treatment on the non-selected region. 

[0041] The present invention yet further provides an electronic camera, including an image 
encoding device, including a transformation component for converting an image into 
transformation coefficients by subjecting the image to a frequency decomposition, the image 
having an area, a dividing component for dividing the transformation coefficients produced by 
the transformation component into a selected region and a non-selected region on the image, the 
non-selected region being an area of the image other than an area defined by the selected region, 
an encoding component for encoding the transformation coefficients by allocating a greater 
j 3 quantity of information to the selected region than to the non-selected region, and a region 

ijl 

p adjustment component for controlling a bit allocation rate of the non-selected region by adjusting 

SI 

O the area of the selected region, the bit allocation rate being a mean amount of code per unit area. 
The electronic camera further includes an imaging component for imaging an object and 
producing image data, wherein the image encoding device encodes the image data produced by 

^ the imaging component. 

[0042] The present invention yet further provides a computer, including an image encoding 
program which allows the computer to function as: a transformation component for converting 
an image into transformation coefficients by subjecting the image to a frequency decomposition, 
the image having an area, a dividing component for dividing the transformation coefficients 
produced by the transformation component into a selected region and a non-selected region on 
the image, the non-selected region being an area of the image other than an area defined by the 
selected region, an encoding component for encoding the transformation coefficients by 
allocating a greater quantity of information to the selected region than to the non-selected region, 
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and a region adjustment component for controlling a bit allocation rate of the non-selected region 
by adjusting the area of the selected region, the bit allocation rate being a mean amount of code 
per unit area. The computer further includes a machine-readable recording medium for 
recording the image encoding program. 

[0043] The present invention yet further provides a method of encoding an image, including 
the steps of converting an image into transformation coefficients by subjecting the image to a 
frequency decomposition, the image having an area, and dividing the transformation coefficients 
into a selected region and a non-selected region on the image, the non-selected region being an 

H= area of the image other than an area defined by the selected region. The method further includes 

Q 

\ ; the steps of encoding the transformation coefficients by allocating a greater quantity of 

rl 

information to the selected region than to the non-selected region, and controlling a bit allocation 

%4 

p rate of the non-selected region by adjusting the area of the selected region, the bit allocation rate 
being a mean amount of code per unit area. 

ru 

O [0044] The method further includes the step of adjusting the area of the selected region by 
!' f taking into account: a bit allocation rate of the image as a whole, a bit allocation rate of the 

selected region, and the bit allocation rate of the non-selected region, wherein, each of the bit 

allocation rates is determined in advance as a target value. 

[0045] Alternatively, the method further includes the step of adjusting the area of the selected 
region by taking into account: a bit allocation rate of the image as a whole, a bit allocation rate of 
the selected region, and a ratio of the bit allocation rate of the selected region to the bit allocation 
rate of the non-selected region, wherein, each of the bit allocation rates and the ratio are 
determined in advance as target values. 
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[0046] Furthermore, the method further includes the steps of determining an adjustment value 
of the area of the selected region by substituting the target values into the following general 
calculation equation: 

y total = y roi x Aroi + y notroi x (1 - Aroi), 
where, y total is the bit allocation rate of the image as a whole, y roi is the bit allocation rate of 
the selected region, Aroi is a proportion of the area of the image as a whole that is occupied by 
the selected region, and y notroi is the bit allocation rate of the non-selected region, and solving 
the equation. 

[0047] The method yet further includes the step of limiting the adjustment value of the area of 
the selected region by at least a pre-determined upper-limit value or a pre-determined lower-limit 
value. 

[0048] The present invention yet further provides a method of encoding an image, including 
the steps of converting an image into transformation coefficients by subjecting the image to a 
frequency decomposition, the image having an area, and dividing the transformation coefficients 
into a selected region and a non-selected region on the image, the non-selected region being an 
area of the image other than an area defined by the selected region. The method further includes 
the steps of encoding the transformation coefficients by allocating a greater quantity of 
information to the selected region than to the non-selected region, and controlling a bit allocation 
rate of the non-selected region by adjusting a bit allocation rate of the selected region. 
[0049] The method further includes the step of adjusting the bit allocation rate of the selected 
region by taking into account a bit allocation rate of the image as a whole, the area of the 
selected region, and the bit allocation rate of the non-selected region, wherein, each of the bit 
allocation rates and the area are determined in advance as target values. 
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[0050] Alternatively, the method further includes the step of adjusting the bit allocation rate 
of the selected region by taking into account a bit allocation rate of the image as a whole, the 
area of the selected region, and a ratio of the bit allocation rate of the selected region to the bit 
allocation rate of the non-selected region, wherein, the bit allocation rate of the image as a 
whole, the area of the selected region and the ratio are determined in advance as target values. 
[0051] Furthermore, the method further includes the step of determining an adjustment value 
of the bit allocation rate of the selected region by substituting the target values into the following 
general calculation equation: 

y total = y roi x Aroi + y notroi x (1 — Aroi), 
where, y total is the bit allocation rate of the image as a whole, y roi is the bit allocation rate of 
the selected region, Aroi is a proportion of the area of the image as a whole that is occupied by 
the selected region, and y notroi is the bit allocation rate of the non-selected region, and solving 
the equation. 

[0052] Moreover, the method further includes the step of limiting the adjustment value of the 
bit allocation rate of the selected region by at least a pre-determined upper-limit value or a pre- 
determined lower-limit value. 

[0053] The present invention yet further provides a method of encoding an image, including 
the steps of converting an image into transformation coefficients by subjecting the image to a 
frequency decomposition, and dividing the transformation coefficients into a selected region and 
a non-selected region on the image, the non-selected region being an area of the image other than 
an area defined by the selected region. The method further includes the steps of encoding the 
transformation coefficients by allocating a greater quantity of information to the selected region 
than to the non-selected region, wherein the transformation coefficients are encoded while 



l-WA/1709005.1 



14 



Attorney Docket No. 040808-5 1 12 

allocation of a quantity of information from a peripheral part of the selected region toward a 
central part of the selected region is gradually increased, and controlling a bit allocation rate of 
the non-selected region by adjusting a slope of increase of the allocation. 
[0054] The present invention yet further provides a method of encoding an image, including 
the steps of converting an image into transformation coefficients by subjecting the image to a 
frequency decomposition, and dividing the transformation coefficients into a selected region and 
a non-selected region on the image, the non-selected region being an area of the image other than 
an area defined by the selected region. The method further includes the steps of encoding the 
transformation coefficients by allocating a greater quantity of information to the selected region 
than to the non-selected region, wherein the transformation coefficients are encoded while 
allocation of a quantity of information from a peripheral part of the selected region toward a 
central part of the selected region is gradually increased, and controlling a bit allocation rate of 
the non-selected region by adjusting a maximum value of a bit allocation rate of the selected 
region. 

[0055] The present invention yet further provides a method of encoding an image, including 
the steps of converting an image into transformation coefficients by subjecting the image to a 
frequency decomposition, and detecting a region of focus on the image. The method further 
includes the steps of determining a selected region on the image on the basis of the region of 
focus, dividing the transformation coefficients into the selected region and a non-selected region 
on the image, the non-selected region being an area of the image other than an area defined by 
the selected region, and encoding the transformation coefficients by allocating a greater quantity 
of information to the selected region than to the non-selected region. 
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[0056] The present invention yet further provides a method of encoding an image, including 
the steps of converting an image into transformation coefficients by subjecting the image to a 
frequency decomposition, and dividing the transformation coefficients into a selected region and 
a non-selected region on the image, the non-selected region being an area of the image other than 
an area defined by the selected region. The method further includes the steps of encoding the 
transformation coefficients by allocating a greater quantity of information to the selected region 
than to the non-selected region, detecting a region of focus on the image, and displacing the 
selected region in direction of the region of focus. 

•Q [0057] The present invention yet further provides a method of encoding an image, including 

0 

the steps of converting an image into transformation coefficients by subjecting the image to a 



frequency decomposition, and receiving an input indicating a selected region on the image. The 
method further includes the steps of setting the selected region in accordance with the input, 
dividing the transformation coefficients into the selected region and a non-selected region on the 
image, the non-selected region being an area of the image other than an area defined by the 
selected region, and encoding the transformation coefficients by allocating a greater quantity of 
information to the selected region than to the non-selected region. 

[0058] It should be noted that in each alternative method of encoding an image discussed 
above, the method further includes the step of reducing noise generated in the non-selected 
region as a result of high-performance encoding by performing a space frequency low-pass 
treatment on the non-selected region. 

[0059] The present invention yet further provides a method of encoding an image in an 
electronic camera, including the steps of imaging an object, thus producing an image having an 
area, producing image data from the image, and encoding the image data by converting the 
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image data into transformation coefficients by subjecting the image data to a frequency 
decomposition, and dividing the transformation coefficients into a selected region and a non- 
selected region of the image, the non-selected region being an area of the image other than an 
area defined by the selected region. The method of encoding further includes the steps of 
encoding the transformation coefficients by allocating a greater quantity of information to the 
selected region than to the non-selected region, and controlling a bit allocation rate of the non- 
selected region by adjusting the area of the selected region, the bit allocation rate being a mean 
amount of code per unit area. 

[0060] The present invention yet further provides a method of encoding an image on a 
computer, including the step of recording an image encoding program on the computer, thus 
allowing the computer to: convert an image into transformation coefficients by subjecting the 
image to a frequency decomposition, the image having an area, divide the transformation 
coefficients into a selected region and a non-selected region on the image, the non-selected 
region being an area of the image other than an area defined by the selected region, encode the 
transformation coefficients by allocating a greater quantity of information to the selected region 
than to the non-selected region, and control a bit allocation rate of the non-selected region by 
adjusting the area of the selected region, the bit allocation rate being a mean amount of code per 
unit area. 

[0061] Additional features, advantages, and embodiments of the invention may be set forth or 
apparent from consideration of the following detailed description, drawings, and claims. 
Moreover, it is to be understood that both the foregoing summary of the invention and the 
following detailed description are exemplary and intended to provide further explanation without 
limiting the scope of the invention as claimed. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

[0062] The accompanying drawings, which are included to provide a further understanding of 
the invention and are incorporated in and constitute a part of this specification, illustrate 
preferred embodiments of the invention and together with the detail description serve to explain 
the principles of the invention. In the drawings: 

[0063] Fig. 1 is a block diagram which illustrates the construction of an electronic camera; 
[0064] Fig. 2 is a flow chart which illustrates the operation of an image encoding device 
according to the present invention, in a first working configuration; 

[0065] Fig. 3 is a diagram which illustrates the displacement of a selected region on the basis 
of the region of focus; 

[0066] Fig. 4 is a flow chart which illustrates the operation of an image encoding device 
according to the present invention, in a second working configuration; 
[0067] Fig. 5 is a flow chart which illustrates the operation of an image encoding device 
according to the present invention, in a third working configuration; and 

[0068] Figs. 6 A - 6F are an explanatory diagram which illustrates adjustment of the selected 
region, in a fourth working configuration. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[0069] Working configurations of the present invention will be described below with 

reference to the attached figures. 

[0070] The first working configuration is a working configuration of an electronic camera. 
[0071] Fig. 1 is a block diagram which illustrates the construction of an electronic camera. 
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[0072] In Fig. 1, an imaging lens 12 is mounted on the electronic camera 11. The imaging 
plane of an imaging element 13 is disposed in the imaging space of imaging lens 12. The focus 
of imaging lens 12 is automatically controlled by a focus control part 12a, so that an image of the 
object of imaging is focused on the imaging plane of imaging element 13. Imaging element 13 
subjects the image of the object of imaging to a photoelectric conversion, and outputs the result 
as an image signal. This image signal is digitized via an AID converter part 14, and is then sent 
to an image processing part 15. Image processing part 15 performs image processing such as 
gradation conversion, black level correction and color interpolation processing on this image 
p signal. Following this image processing, the image signal is sent to an image encoding device 20 
Q inside electronic camera 11. Image encoding device 20 subjects the image signal to the 
Q compression and encoding stipulated by JPEG2000, and outputs a compressed image file. 

Recording part 16 acquires this image file and stores the image file on a recording medium such 
ry as a memory card. 

Sj [0073] The above-mentioned image encoding device 20 is constructed from the constituent 
H elements discussed below. 



[0074] 


(1) Color transformation part 21 


[0075] 


(2) Wavelet transformation part 22 


[0076] 


(3) Quantizing part 23 


[0077] 


(4) Bit plane construction part 24 


[0078] 


(5) Arithmetical encoding part 25 


[0079] 


(6) Formatting part 26 


[0080] 


(7) ROI setting part 27: A mask image indicating the selected region for ROI 



encoding is set. Bit plane construction part 24 divides the transformation coefficients into a 
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selected region and non-selected region while referring to this mask image. Furthermore, bit 
plane construction part 24 allocates the quantity of information by shifting the transformation 
coefficients that have been divided into the selection region upward. 

[0081] (8) ROI designating switch 28: This is a switch that allows the user to input the 
position and extent of the selected region. Specifically, this switch is constructed from a position 
input mechanism such as a cursor key or eye-control input device and a switch used to select the 
extent of the selected region. 

[0082] (9) ROI adjustment part 29: This part determines the selected region in accordance 

U with "the input values of ROI adjustment part 28" and the "target value input," and sets the mask 

5 

O image in ROI setting part 27. Furthermore, ROI adjustment part 28 acquires position 

a 

]£j information concerning the region of focus from the focus control part 12a, and adjusts the 

Si 

position of the selected region so that the region of focus is included in the selected region as far 
Uk as possible. 

S! 

Q Description of Operation of First Working Configuration 

U 

[0083] Fig. 2 is a flow chart which illustrates the operation of the image encoding device 
according to the present invention, in a first working configuration. Fig. 3 is a diagram which 
illustrates the displacement of a selected region on the basis of the region of focus. Below, the 
operation of the first working configuration will be described in specific terms according to the 
operation steps shown in Fig. 2. 

[0084] [Step SO] Here, color transformation part 21 acquires the image signal from the image 
processing part 15, and performs a color coordinate transformation as necessary, thus 
transforming the image signal into color components such as YCbCr. 
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[0085] [Step SI] Here, wavelet transformation part 22 performs a recursive wavelet 
transformation on the image signal following color coordinate transformation, thus producing 
transformation coefficients. 

[0086] [Step S2] Here, quantizing part 23 quantizes the transformation coefficients as 
necessary. 

[0087] [Step S3] Here, electronic camera 11 determines the following target values in 
accordance with the image quality selection (e.g., fine, basic) of the recording mode, and sends 
these values to the ROI adjustment part 29. Where, 

Q y total is the bit allocation rate of the image as a whole, and 

O 

h:: y roi is the bit allocation rate of the selected region. 

yi 

rj 

C'j [0088] hi addition, y total may be a value obtained by dividing the target file size following 

a 

s compression by the total area (e.g., total number of pixels) of the image. Moreover, y roi may be 

I::' a value that is statistically inferred from good image compression results obtained in the past. 

Q 

j4 [0089] [Step S4] Here, electronic camera 11 determines y notroimin in accordance with the 
image quality selection of the recording mode, and sends this value to the ROI adjustment part 
29. The term y notroi_min is the minimum guaranteed bit allocation rate in the non-selected 
region. 

[0090] [Step S5] Here, ROI adjustment part 29 acquires the position and extent of the 
selected region via user input of the ROI designating switch 28. ROI adjustment part 29 
calculates the area ratio Aroi_user of the selected region on the basis of this user input. 
[0091] [Step S6] Here, ROI adjustment part 29 predicts the bit allocation rate y notroi of the 
non-selected region on the basis of the following general approximate formula: 

y notroi = (y total - y roi x Aroi_user) / (1 - Aroi_user) —Equation 2— 
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[0092] [Step S7] Here, ROI adjustment part 29 ascertains whether or not the predicted value 
y notroi is less than the guaranteed value y notroi_min. 

[0093] If it is determined from the results of this ascertainment that the guaranteed value 
y notroi_min can be sufficiently guaranteed by the area ratio Aroi_user (the NO side shown in 
Fig. 2), ROI adjustment part 29 shifts the operation to step S10. 

[0094] On the other hand, if it is determined from the results of this ascertainment that the 
guaranteed value y notroi_min cannot be guaranteed by the area ratio Aroi_user (the YES side 
shown in Fig. 2), ROI adjustment part 29 shifts the operation to step S8. 
'J [0095] [Step S8J Here, ROI adjustment part 29 sets the guaranteed value y notroijmin as 

P the bit allocation rate y notroi of the non-selected region, and takes this as a target value. 

Ml 

O [0096] [Step S9] Here, ROI adjustment part 29 substitutes the target value into the following 

y 

general approximate formula, and determines the area ratio Aroi: 
py Aroi = (y total - y notroi) / (y roi - y notroi) -Equation 3— 

SJ [0097] It should be noted that Equation 3 is obtained by modifying Equation 1 (discussed 

f** above). 

[0098] After the area ratio Aroi has been determined, ROI adjustment part 29 shifts the 
operation to step Sll. 

[0099] [Step S10] Here, ROI adjustment part 29 sets the area ratio Aroi_user "as is" as the 
area ratio Aroi. The operation here corresponds to an operation in which the area ratio Aroi is 
limited with the area ratio Aroi_user as the upper limit. Thus, it is desirable that the user make a 
user input of the maximum selected region so that the entire object of interest is included. 
[00100] [Step Sll] Here, ROI adjustment part 29 acquires the selected position of the focus 
detection area from focus control part 12a. ROI adjustment part 29 detects the region of focus 
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on the basis of this acquired information, and displaces the selected region in the direction of this 
region of focus, as shown in Fig. 3. 

[00101] [Step S12] Here, ROI adjustment part 29 produces a mask image on the basis of the 
position and area ratio Aroi of the selected region determined thus far. ROI adjustment part 29 
sets this mask image in the ROI setting part 27. 

[00102] Moreover, bit plane construction part 24 divides the transformation coefficients into 
regions while referring to the mask image of the ROI setting part 27, and performs bit plane 
encoding while allocating a greater quantity of information to the selected region. Arithmetical 
encoding part 25 performs arithmetical encoding on the data following bit plane encoding. 

[00103] [Step S13] Here, formatting part 26 arranges the arithmetically encoded data 
according to SNR progressive, and thus produces a bit stream. Additionally formatting part 26 
cuts the bit stream using the target file size. 

[00104] Therefore, image encoding according to JPEG2000 is completed as a result of the 
series of operations discussed above. 

Effects, etc.. of the First Working Configuration 

[00105] In the first working configuration, as described above, the area ratio Aroi of the 
selected region is adjusted on the basis of: 

(1) the bit allocation rate y total of the image as a whole, 

(2) the bit allocation rate y roi of the selected region, 

(3) the bit allocation rate y notroi of the non-selected region, and 

(4) the area ratio Aroi_user designated by the user. 



l-WA/1709005.1 



23 



Attorney Docket No. 040808-51 12 

[00106] As a result, the area of the selected region is appropriately adjusted, so that a 
compressed image file in which the image quality balance between the selected region and the 
non-selected region is favorably maintained can be produced. 

[00107] Moreover, in the first working configuration, the position of the selected region is 
determined on basis of the position of the region of focus. As a result, ROI encoding can be 
performed so that the important region on the image known as the region of focus is included, 
thus making it possible to produce an even more favorable compressed image file. 

[00108] Next, a second working configuration will be described. 

Description of Operation of Second Working Configuration 

[00109] The second working configuration is another working configuration of an electronic 
camera according to the present invention. 

[001 1 0] The construction of the electronic camera of the second working configuration is 
similar to that of the first working configuration (e.g., Fig. 1). Accordingly, Fig. 1 will be 
referred to "as is" here, and a description of the construction will be omitted. 

[00111] Fig. 4 is a flow chart which illustrates the operation of the image encoding device 
according to the present invention, in the second working configuration. Below, the operation of 
the image encoding device will be described according to the operating steps shown in Fig. 4. 

[00112] [Steps SO to S2] These steps are the same as in the first working configuration. 

[00113] [Step S20] Here, electronic camera 11 determines the following target values in 
accordance with the image quality selection (e.g., fine, basic) of the recording mode, and sends 
the results to ROI adjustment part 29. Where, 

y total is the bit allocation rate of the image as a whole, and 
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y notroi is the bit allocation rate of the non-selected region. 
[001 14] Furthermore, y total may be a value obtained by dividing the target file size following 
compression by the total area (e.g., total number of pixels) of the image. Moreover, y notroi 
may be a value that is statistically inferred from favorable image compression results obtained in 
the past. 

[00115] [Step S21] Here, electronic camera 11 determines y roijtnax in accordance with the 
image quality selection of the recording mode, and sends the result to ROI adjustment part 29. 
Where, 

U 

p y roi_max is the upper-limit value of the bit allocation rate of the selected region. 

w [001 1 6] Moreover, y roi max may also be a value that is statistically inferred from favorable 

IH 

:*1 image compression results obtained in the past. 

n 

, [00117] [StepS22] Here, ROI adjustment part 29 acquires the position and extent of the 

fy selected region via user input of ROI designating switch 28. ROI adjustment part 29 calculates 

o 

the area ratio Aroi of the selected region on the basis of the extent of this selected region, and 
^ sets this value as a target value. 

[00118] [Step S23] Here, ROI adjustment part 29 calculates the bit allocation rate y roi of the 
selected region by substituting the target values into the following general approximate formula: 

y roi = [y total - y notroi x (1 - Aroi)] / Aroi -Equation 4- 

[00119] It should be noted that Equation 4 is obtained by modifying Equation 1 (discussed 
above). 

[00120] [Step S24] Here, ROI adjustment part 29 determines whether or not the bit allocation 
rate y roi is less than the upper-limit value y roi_max. In cases where the bit allocation rate y roi 
exceeds the upper- limit value y roi_max, ROI adjustment part 29 determines that bit allocation 
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rate y roi is excessive and that this bit allocation rate will destroy the image quality balance 
between the selected region and non-selected region. Thus, ROI adjustment part 29 shifts the 
operation to step S25. 

[00121] On the other hand, in cases where the bit allocation rate y roi is less than the upper- 
limit value y roi_max, ROI adjustment part 29 determines that bit allocation rate y roi is 
suitable, and shifts the operation to step S26. 

[00122] [Step S25] Here, ROI adjustment part 29 limits the bit allocation rate y roi to the 
upper-limit value y roi_max. 

[00123] [Step S26] Here, ROI adjustment part 29 acquires the selected position of the focus 
detection area from focus control part 12a. ROI adjustment part 29 detects the region of focus 
on the basis of this acquired information, and displaces the selected region in the direction of this 
region of focus, as shown in Fig. 3. 

[00124] [Step S27] Here, ROI adjustment part 29 produces a mask image on the basis of the 
position and area ratio Aroi of the selected region determined thus far. ROI adjustment part 29 
sets this mask image in the ROI setting part 27. 

[00125] Moreover, bit plane construction part 24 divides the transformation coefficients into 
regions while referring to the mask image of ROI setting part 27, and performs bit plane 
encoding while allocating a greater quantity of information to the selected region by bit-shifting 
transformation coefficients of the selected region upward. Arithmetical encoding part 25 
performs arithmetical encoding of the data following bit plane encoding. 

[00126] [Step S28] Here, formatting part 26 produces a bit stream by arranging the 
arithmetically encoded data according to SNR progressive. 
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[00127] Additionally, the formatting part 26 cuts the bit stream of the selected region at the 
stage where the bit stream of the selected region exceeds the code quantity Qroi of the following 
equation: 

Qroi = y roi x Aroi x (total number of pixels of the image as a whole) —Equation 5— 
[00128] Furthermore, formatting part 26 cuts the overall bit stream at the stage where this bit 
stream exceeds the target file size. 

[00129] Therefore, image encoding according to JPEG2000 is completed as a result of the 
above-mentioned series of operations. 

Effects, etc.. of the Second Working Configuration 

[00130] In the second working configuration, as described above, the bit allocation rate y roi of 
the selected region is adjusted on the basis of: 

(1) the bit allocation rate y total of the image as a whole, 

(2) the area ratio Aroi of the selected region according to the designation of the user, and 

(3) the bit allocation rate y notroi of the non-selected region. 

[00131] As a result, the bit allocation rate of the selected region can be appropriately adjusted 
and manipulated, so that a compressed image file can be produced in which the image quality 
balance between the selected region and the non-selected region is favorably maintained. 

[00132] Furthermore, in the second working configuration, the position of the selected region 
is determined on basis of the position of the region of focus. As a result, ROI encoding can be 
performed so that the important region on the image known as the region of focus is included, 
thus making it possible to produce an even more favorable compressed image file. 

[00133] Next, a third working configuration will be described. 
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Description of Operation of Third Working Configuration 

[00134] The third working configuration is yet another working configuration of an electronic 
camera according to the present invention. 

[00135] Moreover, the construction of the third working configuration is similar to that of the 
first working configuration (e.g., Fig. 1). Accordingly, Fig. 1 will be referred to "as is," and a 
description of the construction will be omitted. 

[00136] Fig. 5 is a flow chart which illustrates the operation of the image encoding device 
according to the present invention, in the third working configuration. Below, this operation will 

Q 

□ be described according to the operation steps shown in Fig. 5. 

a 

tf! [00137] [Steps SO to S2] These steps are the same as in the first working configuration. 

o 

: ^ [00138] [Step S30] Here, electronic camera 11 determines the following target values in 
L ; accordance with the image quality selection (e.g., fine, basic) of the recording mode, and sends 
A the results to ROI adjustment part 29. The term y total is the bit allocation rate of the image as a 
O whole, and K is the ratio of bit allocation rates of both regions (corresponds to y roi/y notroi). 
[00139] Furthermore, y total may be a value obtained by dividing the target file size following 
compression by the total area (e.g., total number of pixels) of the image. Moreover, K may be a 
value that is statistically inferred from favorable image compression results obtained in the past. 
[00140] [Step S31] Here, ROI adjustment part 29 acquires the position and extent of the 
selected region via user input of ROI designating switch 28. ROI adjustment part 29 calculates 
the area ratio Aroi of the selected region on the basis of the extent of this selected region, and 
sets this value as a target value. 
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[00141] [Step S32] Here, ROI adjustment part 29 calculates the bit allocation rate y roi of the 
selected region by substituting the target values into the following general approximate formula: 
y roi = y total x K / [ 1 + (K - 1 ) Aroi] -Equation 6- 

[00142] It should be noted that Equation 6 is obtained by modifying Equation 1 (discussed 
above). 

[00143] [Step S33] Here, ROI adjustment part 29 limits the bit allocation rate y roi using an 
upper-limit value and a lower-limit value. The upper-limit value and lower-limit value may be 
statistically inferred from favorable image compression results obtained in the past. 
O [00144] [Step S34] Here, ROI adjustment part 29 acquires the selected position of the focus 
' detection area from focus control part 12a. ROI adjustment part 29 detects the region of focus 
;*i on the basis of this acquired information, and displaces the selected region in the direction of this 
* region of focus, as shown in Fig. 3. 

m [00145] [Step S35] Here, ROI adjustment part 29 produces a mask image on the basis of the 
S! position and area ratio Aroi of the selected region determined thus far. ROI adjustment part 29 
sets this mask image in the ROI setting part 27. 

[00146] Moreover, bit plane construction part 24 divides the transformation coefficients into 
regions while referring to the mask image of ROI setting part 27, and performs bit plane 
encoding while allocating a greater quantity of information to the selected region by bit-shifting 
transformation coefficients of the selected region upward. Arithmetical encoding part 25 
performs arithmetical encoding of the data following bit plane encoding. 

[00147] [Step S36] Here, formatting part 26 produces a bit stream by arranging the 
arithmetically encoded data according to SNR progressive. 
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[00148] Additionally formatting part 26 cuts the bit stream of the selected region at the stage 
where the bit stream of the selected region exceeds the code quantity Qroi of the following 
equation: 

Qroi = y roi x Axoi x (total number of pixels of the image as a whole) -Equation 7~ 
[00149] Furthermore, formatting part 26 cuts the overall bit stream at the stage where this bit 
stream exceeds the target file size. 

[00150] Therefore, image encoding according to JPEG2000 is completed as a result of the 
above-mentioned series of operations. 

Effects, etc.. of the Third Working Configuration 

[00151] In the third working configuration, as described above, the bit allocation rate y roi of 
3 the selected region is adjusted on the basis of: 

(1) the bit allocation rate y total of the image as a whole, 

(2) the area ratio Aroi of the selected region according to the designation of the user, and 

(3) the ratio K of the bit allocation rates of both regions. 

[00152] As a result, the bit allocation rate of the selected region can be appropriately adjusted 
and manipulated, so that a compressed image file in which the image quality balance between the 
selected region and the non-selected region is favorably maintained, can be produced. 

[00153] In particular, in the third working configuration, the "ratio K of the bit allocation rates 
of both regions" is used as a target value. This ratio K is a value that directly expresses the 
image quality balance of both regions. Accordingly, the image quality balance of the two 
regions can be directly controlled by using this ratio K as a target value. 
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[00154] Furthermore, in the third working configuration, the position of the selected region is 
determined on the basis of the position of the region of focus. As a result, ROI encoding can be 
performed so that the important region on the image known as the region of focus is included, 
thus making it possible to produce an even more favorable compressed image file. 

[00155] Next, a fourth working configuration will be described. 

Description of Operation of Fourth Working Configuration 

[00156] The fourth working configuration is yet another working configuration of an electronic 
camera according to the present invention. 

[00157] Moreover, the construction of the fourth working configuration is similar to the 
construction of the first working configuration (e.g., Fig. 1). Accordingly, Fig. 1 will be referred 
to "as is" here, and a description of the construction will be omitted. 

[00158] As shown in Figs. 6A - 6F, the characterizing feature of the operation of the fourth 
working configuration is that the bit allocation rate of the selected region is varied in multiple 
stages. The remaining operation is the same as that in the first through third working 
configurations, discussed above. Accordingly, a description of this remaining operation is 
omitted here. 

[00159] Thus, the characterizing feature of such an operation will be described in detail below. 
Multi-Stase Variation of the Bit Allocation rate 

[00160] In the fourth working configuration, as is shown in Figs. 6A - 6F, a region of greatest 
importance is disposed within the selected region. This region of greatest importance is a region 
to which a greater quantity of data is allocated with a special preference even within the selected 
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region. On the other hand, in the periphery of the selected region, the quantity of information is 
allocated more moderately even within the selected region, so that the difference between this 
periphery of the selected region and the non-selected region is not conspicuous. 
[00161] As a result, the bit allocation rate varies in multiple stages from the peripheral part of 
the selected region toward the region of greatest importance. 

Means Used to Realize Multistage Variation 

[00162] Such a multi-stage variation in the bit allocation rate is realized by the operation 
u discussed below. 

Q [00163] First, ROI adjustment part 29 adjusts the selected region. On the basis of the results 

Q 

!J1 of this adjustment operation, ROI adjustment part 29 produces a multi-value mask image which 

a 

^ indicates a multi-stage bit allocation rate in pixel units, and sets this mask image in ROI setting 
f part 27. 

' ■! [00164] Next, the multi-stage variation of the bit allocation rate is specifically executed by at 
p least one of the component described below. 

[00165] • Quantizing part 23 determines multiple stages of quantizing steps while referring to 

the mask image, and quantizes the transformation coefficients in multiple stages. 
[00166] • Bit plane construction part 24 determines multiple stages of bit shift numbers while 
referring to the mask image, and shifts the transformation coefficients upward in 
multiple stages. 

[00167] • Formatting part 26 cuts the bit stream in multiple stages in accordance with the 
reference value (bit allocation rate) of the mask image. 
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[00168] Additionally, the formatting part 26 includes the above-mentioned multi-value mask 
image in the compressed image file. As a result, this mask image can also be used in decoding 
the compressed image file. 

Rough Adjustment of the Selected Region 

[00169] If such a multi-stage bit allocation rate is expressed in the form of a bit allocation rate 
W(x, y) at a position (x, y), then the average bit allocation rate y roi_ave for the selected region 
is as follows: 

yroi_ave= J] W(x,y)/Nroi -Equation 8 - 

x,y 6 ROI 

(Here, Nroi is the number of pixels of the selected region.) 
[00170] Accordingly, a rough adjustment of the selected region can be accomplished in the 
same manner as in the first through third working configurations, discussed above, by using this 
average bit allocation rate y roi_ave instead of the bit allocation rate y roi used in the first 
through third working configurations. 

Fine Variations of the Adjustment Operation of the Selected Region 

[00171] By utilizing the degree of freedom of the bit allocation rate, ROI adjustment part 29 
can apply the fine variations to the adjustment of the selected region, as discussed below. 

[00172] [A] As shown in Fig. 6 A, in area adjustment of the selected region, ROI adjustment 
part 29 adjusts the areas of the selected region and region of greatest importance at a fixed ratio. 
In this case, the slope of increase of the bit allocation rate is also adjusted. Such an area 
adjustment is suitable for use in cases where the quantity of information allocated to the selected 
region is greatly adjusted. 
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[00173] [B] As shown in Fig. 6B, in area adjustment of the selected region, ROI adjustment 
part 29 keeps the area of the region of greatest importance constant, and adjusts the area of the 
selected region. In this case, the slope of increase of the bit allocation rate is also adjusted. Such 
an area adjustment is suitable for use in cases where the region of greatest importance cannot be 
altered, such as cases in which the region of greatest importance is set in accordance with the 
size of the object of imaging. 

[00174] [C] As shown in Fig. 6C, in area adjustment of the selected region, ROI adjustment 
part 29 keeps the area of the selected region constant, and adjusts the area of the region of 
i . greatest importance. In this case, the slope of increase of the bit allocation rate is also adjusted. 
Such an area adjustment is suitable for use in cases where the selected region cannot be altered, 

5 

if! such as cases in which the selected region is set in accordance with the size of the object of 

0 

H imaging. 

■ [00175] [D] As shown in Fig. 6D, in area adjustment of the selected region, ROI adjustment 
» * part 29 adjusts the areas of both the selected region and the region of greatest importance while 
fj keeping the slope of the bit allocation rate at a constant value. In this case, since the slope of the 
bit allocation rate is maintained at a constant value, this adjustment operation is suitable for use 
in cases where it is desired to prevent the boundary between the selected region and the non- 
selected region from becoming noticeable. 

[00176] [E] As shown in Fig. 6E, in adjustment of the bit allocation rate, ROI adjustment part 
29 adjusts the maximum bit allocation rate of the region of greatest importance while 
maintaining the slope of the bit allocation rate at a constant value. In this case, the area of the 
selected region is adjusted as a result. Furthermore, since the slope of the bit allocation rate is 
maintained at a constant value in this case, this adjustment operation is suitable for use in cases 
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where it is desired to prevent the boundary between the selected region and the non-selected 
region from becoming noticeable. 

[00177] [F] As shown in Fig. 6F, in adjustment of the bit allocation rate, ROI adjustment part 
29 adjusts the maximum bit allocation rate of the region of greatest importance while 
maintaining the area of the selected region at a constant value. In this case, the slope of the bit 
allocation rate is also adjusted. Such an adjustment of the bit allocation rate is an adjustment 
operation suitable for use in cases where the selected region cannot be altered, such as cases in 
which the selected region is set in accordance with the size of the object of imaging. 
U [001781 It should be noted that more specific and diverse variations can be applied to the 
O adjustment operation of the selected region by performing the above-mentioned area adjustments 
Zl A through D (Figs. 6A - 6D) in combination with the bit allocation rate adjustments E and F 
ft (Figs. 6E - 6F). 
U 

ru 

Q Items Supplementary to the Working Configurations 

% 4 

0 [00179] In the above-mentioned first through fourth working configurations, the image is 

U 

transformed into transformation coefficients by performing a wavelet transformation. However, 
the present invention is not limited to such a transformation. In general, it is sufficient if the 
image is transformed into transformation coefficients using frequency decomposition. 
[00180] For example, orthogonal transformations such as a discrete cosine transformation, 
discrete Fourier transformation, Hadamard transformation or Karhunen-Loeve transformation 
can be used. In the case of such orthogonal transformations, it is desirable that the image be 
divided into the selected region and non-selected region using the minimum processing blocks of 
the orthogonal transformation as units. 
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[00181] Furthermore, the image may also be transformed into transformation coefficients by 
sub-band decomposition. Besides wavelet transformation, such sub-band decomposition also 
includes pyramid-hierarchical encoding. 

[00182] Additionally, in the above-mentioned first through fourth working configurations, the 
bit allocation rate of the selected region is controlled by cutting the bit stream. However, the 
present invention is not limited to this. For example, it would also be possible to control the bit 
allocation rate of the selected region by using the quantizing part 23 to adjust the quantizing 
steps of the selected region. Alternatively, it would also be possible to control the bit allocation 

y& rate of the selected region by using bit plane construction part 24 to adjust the bit shift number of 

Q 

Q the selected region. 

Q 

■ [00183] Moreover, in the above-mentioned working configurations, it would also be possible 

to adjust area ratio Aroi of the selected region using: 
U (1) the bit allocation rate y total of the image as a whole, 

ry 

S (2) the bit allocation rate y roi of the selected region, and 

if 

(3) the ratio K of the bit allocation rates of both regions, 

Mi 

as target values, as discussed above. 

[00184] Furthermore, area ratio Aroi of the selected region may also be determined by 
substituting these target values into the following equation, as discussed above. 

Aroi = (K x y total / y roi - 1 ) / (K - 1 ) -Equation 9- 

[00185] It should be noted that Equation 9 is obtained by modifying Equation 1 (discussed 
above). 

[00186] Additionally, in the above-mentioned working configurations, it would also be 
possible to limit area ratio Aroi in accordance with at least an upper-limit value or a lower-limit 



l-WA/ 1709005.1 



36 



Attorney Docket No. 040808-5 1 12 

value (or both). Such an upper-limit value and lower-limit value may be values that are 
statistically inferred from favorable image compression results that have been obtained in the 
past. As a result of such limits, the danger that the area ratio Aroi will be set as a biased value is 
eliminated, so that the area of the ROI region can be adjusted much more appropriately. 
[00187] Moreover, in the above-mentioned working configurations, bit allocation rate y roi 
may also be limited in accordance with at least an upper-limit value or a lower-limit value (or 
both). Such an upper-limit value and lower-limit value may be values that are statistically 
inferred from favorable image compression results that have been obtained in the past. As a 
U result of such limits, the danger that the bit allocation rate y roi will be set as a biased value is 

5 

2 eliminated, so that the bit allocation rate y roi can be adjusted much more appropriately. 

m 

' > [00188] Furthermore, in the above-mentioned working configurations, the region of focus is 

%j 

n detected on basis of the selection of the focus detection area. However, the present invention is 

U not limited to this. For example, it would also be possible to detect the region of focus on the 

m 

C3 image by contrast detection or space frequency analysis of the image. 

SI 

[00189] Additionally, in the above-mentioned working configurations, the selected region is 
displaced in the direction of the region of focus. This is advantageous in that the position of the 
selected region can be flexibly determined while taking into account both the designation of the 
user and the region of focus. However, the present invention is not limited to this. For example, 
it would also be possible to set the position of the selected region with the region of focus at the 
center. Furthermore, the position and extent of the selected region may be adjusted so that the 
region of focus is included to the maximum extent possible. 

[00190] Moreover, in the above-mentioned working configurations, although designation of 
the selected region by the user is viewed with importance, the selected region is appropriately 
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varied in accordance with the target values. This is advantageous in that the selected region can 
be skillfully adjusted while taking into account both the designation of the user and the target 
values. However, the present invention is not limited to this. For example, it would also be 
possible to install an operating mode in which the selected region is set "as is" in accordance 
with the designation of the user. Furthermore, an operating mode in which the selected region is 
set on basis of image information may also be installed. 

[00191] Furthermore, in the above-mentioned first through fourth working configurations, a 
space frequency low-pass treatment may be applied to the non-selected region, as discussed 
above. For example, ROI adjustment part 29 determines the selected region prior to frequency 
decomposition of the image (steps SO to S2). Next, ROI adjustment part 29 discriminates the 
non-selected region from the image prior to frequency decomposition, and performs a space 
frequency low-pass treatment such as Gauss gradation on this non-selected region. In regard to 
the low-pass characteristics in this case, it is desirable that high-band signal components that are 
lost in high-efficiency encoding be suppressed beforehand. As a result of such a treatment, the 
deterioration in image quality that occurs in high-efficiency encoding is reduced, thus making the 
noise of the decoded image unnoticeable. 

[00192] Additionally, in the above-mentioned working configurations, an electronic camera 11 
on which an image encoding device 20 is mounted was described. However, the present 
invention is not limited to an electronic camera. More broadly, present invention is a technique 
that can be used in image encoding in general. 

[00193] For example, an image encoding program for executing the operations of the above- 
mentioned working configurations in a computer can be prepared. The recording medium 
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discussed above can be obtained by recording this image encoding program on a recording 
medium. 

[00194] Moreover, operation of the present invention in regard to the above-mentioned 
program and program recording medium is not limited by the above-mentioned working 
configurations. For example, such a program may be distributed via communications circuits, 
and the program may be recorded for example, in a system memory or a hard disk of the 
destination computer. By such program distribution, the program distribution source can 
manufacture the program or program recording medium in destination locations. Moreover, by 
u such program distribution, the distribution source can transfer the program or program recording 

< i medium to the destinations. Furthermore, the fact that the program can be distributed may be 

O 

HI published via a communications circuit, and a service which provides information on the 
y_ program storage location may be performed. 

Mi 

]i% Effect of the Invention 

Q [00195] In the image encoding device according to the present invention, the area of the 

selected region is adjusted when the selected region is designated. In fixed-length compression, 
such an area adjustment makes it possible to control the quantity of information that is 
distributed to the non-selected region. As a result, the image quality balance between the 
selected region and the non-selected region can be controlled to a desired state. 
[00196] Furthermore, in the image encoding device according to the present invention, the area 
of the selected region is adjusted on basis of the "bit allocation rate of the image as a whole," "bit 
allocation rate of the selected region" and "bit allocation rate of the non-selected region," which 
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are pre-determined as target values. Accordingly, the area of the selected region can be quickly 
determined without any illogical adjustment of the area of the selected region. 

[00197] Additionally, in the image encoding device according to the present invention, the area 
of the selected region is adjusted on basis of the "bit allocation rate of the image as a whole," "bit 
allocation rate of the selected region" and "ratio of the bit allocation rates of both regions," 
which are given beforehand as target values. Accordingly, the area of the selected region can be 
quickly determined without any illogical adjustment of the area of the selected region. 

[00198] Moreover, in the image encoding device according to the present invention, the area of 
the selected region can easily be determined by substituting the target values into Equation 1. 

[00199] Furthermore, in the image encoding device according to the present invention, an 
adjustment operation is performed with an upper limit and lower limit applied to the area of the 
selected region. Accordingly, there is no danger that the selected region will be adjusted to an 
illogical area. 

[00200] For example, a case may be envisioned in which the quantity of image information 
contained in the non-selected region is small to begin with, so that the bit allocation rate of the 
non-selected region cannot be effectively raised regardless of how far the area of the selected 
region is narrowed. In such a case, unnecessary narrowing of the area of the selected region can 
be avoided by applying a lower limit to the area of the selected region. 

[00201] Additionally, a case may also be envisioned in which the quantity of image 
information in the image as a whole is small to begin with, so that the bit allocation rate of the 
non-selected region cannot be effectively lowered regardless of how far the area of the selected 
region is expanded. In such a case, unnecessary expansion of the area of the selected region can 
be avoided by applying an upper limit to the area of the selected region. 
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[00202] Moreover, in the image encoding device according to the present invention, the bit 
allocation rate of the selected region is adjusted when the selected region is designated. In fixed- 
length compression, the bit allocation rate of the non-selected region can be controlled by such 
an adjustment. As a result, the image quality balance between the selected region and the non- 
selected region can be controlled to a desired state. 

[00203] Furthermore, in the image encoding device according to the present invention, the bit 
allocation rate of the selected region is adjusted on basis of the "bit allocation rate of the image 
as a whole," "area of the selected region" and "bit allocation rate of the non-selected region," 
u, which are pre-determined as target values. Accordingly, the bit allocation rate of the selected 
jjjjj region can be quickly determined without any illogical adjustment of the bit allocation rate of the 

Ei 

Ul selected region. 

Q 

N [00204] Additionally, in the image encoding device according to the present invention, the bit 
? allocation rate of the selected region is adj usted on basis of the "bit allocation rate of the image 

as a whole," "area of the selected region" and "ratio of the bit allocation rates of both regions," 
f =j which are pre-determined as target values. Accordingly, the bit allocation rate of the selected 

region can be quickly determined without any illogical adjustment of the bit allocation rate of the 

selected region. 

[00205] Moreover, in the image encoding device according to the present invention, the bit 
allocation rate of the selected region can easily be determined by substituting the target values 
into Equation 1. 

[00206] Furthermore, in the image encoding device according to the present invention, an 
adjustment operation is performed with an upper limit and lower limit applied to the bit 
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allocation rate of the selected region. Accordingly, there is no danger that the selected region 
will be adjusted to an illogical bit allocation rate. 

[00207] For example, a case may be envisioned in which the amount of image information 
contained in the non-selected region is small to begin with, so that the bit allocation rate of the 
non-selected region cannot be effectively raised regardless of how far the bit allocation rate of 
the selected region is lowered. In such a case, unnecessary lowering of the bit allocation rate of 
the selected region can be avoided by applying a lower limit to the bit allocation rate of the 
selected region. 

J00208] Additionally, a case may also be envisioned in which the amount of image information 

p contained in the selected region is small to begin with, so that the bit allocation rate of the 

O 

U1 selected region does not actually rise regardless of how high the bit allocation rate of the selected 

C3 

Jjj region is set. In such a case, setting the bit allocation rate of the selected region at an 

I . unnecessarily high value can be avoided by applying an upper limit to the bit allocation rate of 

m the selected region. 

p[00209] Moreover, in the image encoding device according to the present invention, the slope 
of increase of the quantity of information allocated to the selected region is adjusted when the 
selected region is designated. In fixed-length compression, the quantity of information 
distributed to the non-selected region can be controlled by means of such an adjustment. As a 
result, the image quality balance between the selected region and the non-selected region can be 
controlled to a desired state. 

[00210] Furthermore, in the image encoding device according to the present invention, the 
maximum value of the bit allocation rate allocated to the selected region is adjusted when the 
selected region is designated. In fixed-length compression, the quantity of information 
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distributed to the non-selected region can be controlled by means of such an adjustment. As a 
result, image quality balance between the selected region and the non-selected region can be 
controlled to a desired state. 

[0021 1] Additionally, in the image encoding device according to the present invention, the 
selected region is determined on basis of the region of focus of the image. Accordingly, the 
selected region, known as the region of focus, can be appropriately designated in accordance 
with the major interest of the user. 

[00212] Moreover, in the image encoding device according to the present invention, the 
. s selected region is displaced in direction of the region of focus of the image when the selected 

Pi region is designated. As a result, the selected region, known as the region of focus, can be 

w 

HI skillfully adjusted so that this region approaches the major interest of the user. 

0 

%[00213] Furthermore, in the image encoding device according to the present invention, the 

f selected region is designated according to the designating input of the user. Accordingly, the 

m 

^ user can freely set the selected region in accordance with the desired position, size or shape. 

j<400214] Additionally, in the image encoding device according to the present invention, a space 
frequency low-pass treatment is performed on the non-selected region. For example, in cases 
where a space frequency low-pass treatment is performed on the non-selected region prior to 
encoding, the high-band signal components that are lost as a result of high-efficiency encoding 
of the non-selected region are reduced in advance, so that deterioration in the image quality of 
the non-selected region can be prevented from becoming noticeable. 

[00215] Next, an electronic camera can be constructed equipped with the image encoding 
device according to the present invention. 
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[00216] Finally, the image encoding device according to the present invention can be realized 
in a computer. 

Although the foregoing description is directed to the preferred embodiments of the 
invention, it is noted that other variations and modifications will be apparent to those skilled in 
the art, and may be made without departing from the spirit or scope of the invention. 
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